A system for configuring a hearing device

ABSTRACT

A system is disclosed for configuring a hearing device. The system comprises an audiogram processing component arranged to process image data indicative of an image of an audiogram associated with a person so as to produce audiogram data indicative of the audiogram, and a hearing device configuration component arranged to produce hearing device configuration data based on the audiogram data. The configuration data is indicative of configuration settings for a hearing device that will cause the hearing device to assist the hearing of the person.

FIELD OF THE INVENTION

The present Invention relates to a system for configuring a hearingdevice.

BACKGROUND OF THE INVENTION

When a person suspects that he/she has difficulty hearing, the personmay seek advice from a hearing health professional such as anaudiologist, pharmacist or other health care professional. The degree ofhearing loss experienced can be diagnosed by completing a hearing test,which generally produces an audiogram showing hearing thresholds (dB) atseveral test frequencies (Hz) separately for left and right ears. Theaudiogram is a direct representation of the hearing capabilities of aperson and can be used to form the basis of a prescription andconfiguration of a hearing device such as a hearing aid or other hearingassistance instrument. A printed or electronically stored copy of theaudiogram is typically given to the person by the hearing healthprofessional.

However, an audiogram is difficult for a lay person to understand andinterpret, which necessitates the person using a hearing healthprofessional to appropriately configure the hearing assistance device.

It is also known that people with diagnosed hearing loss often choosenot to accept a hearing device when an audiogram is produced despitebeing offered one and despite receiving advice that it may improve theirhearing capabilities.

SUMMARY OF THE INVENTION

In accordance with a first aspect of the present invention, there isprovided a system for configuring a hearing device, the systemcomprising:

-   -   an audiogram processing component arranged to process image data        indicative of an image of an audiogram associated with a person        so as to produce audiogram data indicative of the audiogram; and    -   a hearing device configuration component arranged to produce        hearing device configuration data based on the audiogram data,        the configuration data indicative of configuration settings for        a hearing device that will cause the hearing device to assist        the hearing of the person;    -   wherein the hearing device configuration component is arranged        to obtain information indicative of the capabilities of the        hearing device and to produce configuration data using the        information indicative of the device capabilities of the hearing        device.

In an embodiment, the system comprises a camera arranged to captureimage data indicative of an audiogram.

In an embodiment, the system is arranged to enable a user to align anaudiogram with an image capture frame, for example using gestures, inorder to capture the image data indicative of the audiogram.

In an embodiment, the system is arranged to receive image dataindicative of an audiogram through a communications link, for exampleusing USB, Bluetooth or Wi-Fi protocols.

In an embodiment, the system is arranged to obtain air conductionmeasurements from the audiogram and to include data indicative of theair conduction measurements in the audiogram data.

In an embodiment, the system is arranged to obtain bone conductionmeasurements from the audiogram and to include data indicative of thebone conduction measurements in the audiogram data.

In an embodiment, the audiogram processing component is arranged toprocess image data indicative of an image of an audiogram so as toproduce audiogram data indicative of the audiogram using a templatematching process, for example by localising common audiogram symbols andstructure.

In an embodiment, the audiogram processing component is arranged toprocess image data indicative of an image of an audiogram so as toproduce audiogram data indicative of the audiogram using support vectormachines.

In an embodiment, the audiogram processing component is arranged toprocess image data indicative of an image of an audiogram so as toproduce audiogram data indicative of the audiogram using at least oneneural network.

In an embodiment, the hearing device configuration component is arrangedto use formulae NAL-R, NAL-NL1 or NAL-NL2 to produce the hearing deviceconfiguration data from the audiogram data.

In an embodiment, the hearing device configuration component is arrangedto use configuration information Indicative of the age and sex of aperson, whether the person is an experienced hearing device user, and/orthe primary language of the person to produce the hearing deviceconfiguration data from the audiogram data.

In an embodiment, the hearing device configuration component is arrangedto produce configuration data in consideration of the devicecapabilities of the hearing device.

In an embodiment, the system is arranged to query the hearing device forthe device capabilities.

In an embodiment, the system is arranged to enable an operator tomanually enter the device capabilities.

In an embodiment, the system is arranged to retrieve device capabilitiesassociated with the hearing device from a storage device.

The system may include the storage device. Alternatively, the storagedevice may be in networked communication with the system such that thestorage device is accessible by the system through a network.

In an embodiment, the system is arranged to query the hearing device inorder to obtain identification information indicative of the type ofhearing device, and to use the identification information to retrievethe device capabilities associated with the hearing device from thestorage device.

In an embodiment, the device capabilities include device frequencyrange, maximum gain, type of ear tip fitted and/or whether the hearingdevice is an open or closed fit device or custom molded device.

In an embodiment, the system is arranged to communicate wirelessly witha hearing device, for example using Bluetooth or Wi-Fi protocols.

In an embodiment, the system is arranged to communicate with a hearingdevice through a wired connection, for example using USB protocols.

In an embodiment, the system comprises a computing device arranged to:

-   -   implement the audiogram processing component and the hearing        device configuration component; and    -   communicate with the hearing device.

In an embodiment, the configuration data is stored in the computingdevice.

Alternatively or in addition, the configuration data is stored remotelyof the computing device, the configuration data accessible from anetworked remote location.

In an embodiment, the system is arranged to enable the computing deviceto download a software application arranged to implement the system whenthe software application is installed on the computing device.

In an embodiment, the computing device is a smartphone.

In an embodiment, the system is arranged to analyze the audiogram datato determine whether the audiogram data is representative of a medicalcondition that may require treatment.

In an embodiment, the system is arranged to process the audiogram dataso as to compare the audiogram data with audiogram reference data, andcreate hearing analysis information based on the comparison, the hearinganalysis information indicative of whether the audiogram data issuggestive of a hearing problem.

In an embodiment, the audiogram reference data is indicative of specifichearing conditions.

In an embodiment, the audiogram reference data is indicative ofaudiogram data previously obtained from the person, the system using thecomparison between the audiogram data and the audiogram data previouslyobtained from the person in order to determine at least one trend in theperson's hearing.

In an embodiment, the at least one trend includes whether significanthearing loss has occurred; whether significant hearing loss has occurredin one ear compared to the other ear; or whether a sudden onset ofhearing loss, a rapidly progressing hearing loss or conductive hearingloss has occurred.

In an embodiment, the system is arranged to receive vertigo informationfrom a user indicative that the user suffers from vertigo and to use thevertigo information and the audiogram data to diagnose a medicalcondition associated with the user's ears.

In an embodiment, the system is arranged to generate an alert to a userif the system determines that the audiogram data is representative of amedical condition that may require treatment.

In an embodiment, the system is arranged to validate the audiogram databy communicating with the hearing device to generate tones at levelsbased on the hearing thresholds defined in the audiogram data, andreceiving a response from a person when the person has heard the tone.The response may be a received manually by the person physicallyinteracting with the system or by visually recognizing an actionperformed by the person.

In an embodiment, the system is arranged to obtain audiogram datadirectly from a person by performing a hearing assessment on the personusing the hearing device.

The hearing assessment may include a Hughson-Westlake process or aModified Hughson-Westlake process and the system may be arranged tocause the hearing device to generate tones of defined frequencies and tomonitor responses from the person.

In an embodiment, the system is arranged to generate audio tonescorresponding to hearing thresholds consistent with the capabilities ofthe hearing device.

In an embodiment, the system includes at least one hearing device.

In an embodiment, the hearing device is operable in a normal modewherein the hearing device is arranged to enhance hearing, receivestreamed audio, and/or operate as a wireless headset for telephony.

In an embodiment, the hearing device is operable in a hearing assessmentmode wherein a user is provided with examples of the sounds that will bepresented to the user during the hearing assessment, and wherein ahearing assessment is carried out on a person.

In an embodiment, the hearing device is operable in a fitting modewherein a user is provided with sounds to evaluate whether left andright hearing devices are properly fitted into the user's ears.

In an embodiment, the system is arranged such that during a hearingassessment, the hearing device restricts or prevents functionality ofhearing device, for example so as to not allow reception of incomingcalls, user input from controls on the hearing device, or reception ofstreamed audio, such as music.

In an embodiment, the hearing device is arranged to remain in hearingassessment mode while a hearing assessment process is active, and toswitch to normal mode if a hearing assessment process is inactive. Thesystem may be arranged to repeatedly poll the hearing device, and thehearing device arranged to switch to normal mode if a poll communicationis not received after a defined period of time.

In an embodiment, during a hearing assessment, the tones include a puretone, a pulsed tone, a warble tone, a pulsed warble tone, band limitednoise or any other suitable sound for use during a hearing assessment.

In an embodiment, during a hearing assessment, the system is arranged togenerate sound generation commands and to send the sound generationcommands to the hearing device, each sound generation command usable bythe hearing device to create sound associated with the command.

In an alternative embodiment, during a hearing assessment, the system isarranged to stream sounds to the hearing device.

In an embodiment, the hearing device is arranged to assess the level ofbackground ambient noise and determine whether the level of backgroundambient noise is sufficiently low to carry out a hearing assessment. Thehearing device may comprise at least one microphone, the hearing deviceusing the microphone to assess the level of background ambient noise.

In an embodiment, the system is arranged to generate a low frequencytone and to assess whether the hearing device is properly fitted Into auser's ear by determining whether the user has heard the low frequencytone. The low frequency tone may be a continuous tone, a pulsed tone, apulsed warble tone or a heartbeat tone.

In an embodiment, the system is arranged to display a hearing resultsindicator, the hearing results indicator communicating graphically thehearing characteristics of a person associated with audiogram data.

The hearing results indicator may include a left ear portion includinggraphical information associated with hearing capabilities of the personin a left ear, and a right ear portion including graphical informationassociated with hearing capabilities of the person in a right ear. Theright and left ear portions may correspond to hemispheres of a circle.

In an embodiment, each ear portion includes multiple concentric ringportions, each ring portion corresponding to a different frequency usedin the hearing assessment.

In an embodiment, the length of each ring portion corresponds to thestrength of hearing at the frequency associated with the ring portion.The ring portions may be represented differently based on whether thering portions are associated with the left or right ear, for example bydisplaying the ring portions in different colours, and may berepresented differently based on the relevant frequency, for example bydisplaying the ring portions for each ear in different shades of thesame colour.

In an embodiment, the system is arranged to facilitate editing of theaudiogram data. The system may be arranged to display a visualrepresentation of the audiogram data, and to enable a person to modifythe visual representation and thereby the audiogram data.

In an embodiment, the system is arranged to allow a person to modify theconfiguration data either directly or Indirectly. The modifications maybe carried out while the hearing device is being worn.

The modifications may include modification of a gain, feedback response,frequency response, compression parameter or other parameters such astinnitus related parameters.

During modification, the hearing device configuration data may beupdated on the hearing device on-the-fly so that a wearer of the hearingdevice can hear changes as they are being made.

Also disclosed is a system for configuring a hearing device, the systemcomprising:

-   -   audiogram data indicative of an audiogram associated with a        person;    -   a hearing device configuration component arranged to produce        hearing device configuration data based on the audiogram data,        the configuration data indicative of configuration settings for        a hearing device that will cause the hearing device to assist        the hearing of the person; and    -   an audiogram data analysis component arranged to analyse the        audiogram data to determine whether to communicate        recommendation information to the person, the recommendation        information indicative of a recommendation to carry out a        hearing related action;    -   the system arranged to communicate the recommendation        information to the person if the determination is affirmative.

In an embodiment, the recommendation information is indicative of areferral to a health professional.

In an embodiment, the audiogram data analysis component is arranged toretrieve the recommendation information from a referral database.

In an embodiment, the audiogram data analysis component is arranged toretrieve the recommendation Information based on defined criteria, forexample based on locality.

In an embodiment, the system includes a location device arranged toproduce location information indicative of the location of the system,and the system is arranged to use the location information to selectrecommendation information indicative of a referral to a healthprofessional based on the location of the professional.

In an embodiment, the system is arranged to compare a user's electroniccalendar with an accessible electronic calendar of a selected hearinghealth professional so that a mutually free timeslot for the user andthe hearing health professional can be identified.

In an embodiment, the audiogram data analysis component is arranged toanalyse the audiogram data with reference to capabilities of a hearingdevice associated with a person, and to determine whether thecapabilities of the hearing device are suitable for the hearingcapabilities of the person defined in the audiogram data, and the systemis arranged to communicate recommendation information indicative of adifferent hearing device if the different hearing device has moresuitable capabilities than the hearing device associated with theperson.

In an embodiment, the recommendation information may be displayed to theperson and/or electronically communicated to one or more relevantpeople.

Also disclosed is a system for configuring a hearing device, the systemcomprising:

-   -   an audiogram creation component arranged to produce audiogram        data associated with a person by causing a hearing assessment to        be performed on the person using the hearing device, the hearing        assessment including generation of sounds of defined frequencies        and recording responses from the person; and    -   a hearing device configuration component arranged to produce        hearing device configuration data based on the audiogram data,        the configuration data indicative of configuration settings for        a hearing device that will cause the hearing device to assist        the hearing of the person.

In accordance with a second aspect of the present invention, there isprovided a method of configuring a hearing device, the methodcomprising:

-   -   processing image data indicative of an image of an audiogram        associated with a person so as to produce audiogram data        indicative of the audiogram;    -   producing hearing device configuration data based on the        audiogram data, the configuration data indicative of        configuration settings for a hearing device that will cause the        hearing device to assist the hearing of the person;    -   obtaining information indicative of the capabilities of the        hearing device; and    -   producing configuration data using the information indicative of        the device capabilities of the hearing device.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will now be described, by way of example only,with reference to the accompanying drawings, in which:

FIG. 1 is a diagrammatic representation of a system for configuring ahearing device in accordance with an embodiment of the presentinvention;

FIG. 2 is a schematic block diagram of a smartphone for use in thesystem shown in FIG. 1;

FIGS. 3 and 4 show block diagrams of functional components of the systemshown in FIGS. 1 and 2;

FIG. 5 is a diagrammatic representation of an alternative system forconfiguring a hearing device in accordance with an embodiment of thepresent invention;

FIG. 6 shows an example audiogram;

FIG. 7 shows a smartphone during capture of an image of an audiogram;

FIG. 8 shows a smartphone during editing of a captured audiogram image;

FIG. 9 is a schematic block diagram of a hearing device of the systemshown in FIG. 1; and

FIGS. 10 to 25 are diagrammatic representations of screens presented toa user during a hearing assessment carried out by the system.

DESCRIPTION OF AN EMBODIMENT OF THE INVENTION

Referring to FIG. 1 of the drawings, there is shown a representation ofan embodiment of a system 10 for configuring a hearing device.

During use, the system is arranged to capture an image 12 of anaudiogram using a computing device, in this example a smartphone 14provided with a camera 16, and to process the captured audiogram imageso as to produce configuration data indicative of configuration settingsfor a hearing device 18 that will cause the hearing device to assist thehearing of a person associated with the audiogram. In this way, ahearing device 18 can be specifically configured for a person's hearingcapabilities by using the audiogram associated with the person toautomatically modify settings of the hearing device 18 to suit theperson.

Importantly, configuration of the hearing device 18 can be achieved by aperson without the need for the person to have any technical expertisein relation to audiograms and/or in relation to configuration of thehearing device 18.

It will be understood that the system 10 may be implemented using anysuitable computing device capable of executing programs, displayinginformation to a user and receiving inputs from the user. For example,the computing device may be of portable type that includes a touchscreen capable of receiving inputs from a user, or a personal computerhaving a keyboard and mouse.

In this example, the computing device is a smartphone 14 arranged tocommunicate wirelessly with the hearing device 18, in this example apair of left and right hearing devices 18, for example using a Bluetoothor WiFi communication protocol, although it will be understood that anysuitable communications arrangement is envisaged.

As shown in FIG. 2, the smartphone 14 includes a camera 16, and aprocessor 20 arranged to implement programs stored in a data storagedevice 22 using memory 24 in order for the smartphone to implementdesired functionality of the system 10. The smartphone 14 also includesa touch screen 28 overlaid on a display device 26. As such, inputs areprimarily effected by touching the touch screen using taps, swipes andany other device recognizable gestures. The smartphone 14 also includesa location device arranged to produce location information indicative ofthe location of the smartphone, in this example a GPS device 29.However, it will be understood that the system 10 is equally applicableto implementations on other computing devices.

Referring to FIG. 3, a block diagram is shown of functional components30 of the system 10. The functional components 30 in this exampleinclude process components implemented by the processor 20; and systemdata stored in the data storage device 22, the system data includingdata indicative of processes Implemented by the processor 20 and datausable by and produced by the processes implemented by the processor 20.

In this example, the functional components 30 include an audiogramcapturing component 32 arranged to facilitate capture of an audiogramassociated with a person using the camera 16; an audiogram processingcomponent 34 arranged to process the captured audiogram to produceaudiogram data 36 indicative of the captured audiogram; an audiogramdata analysis component 42 arranged to analyze the audiogram data 36 inorder to determine the likelihood of a medical issue; an audiogramvalidation component 48 arranged to cooperate with the hearing device 18to validate the audiogram data 36; an audiogram editing component 50arranged to facilitate editing of the audiogram data 36, for example inorder to ensure that the audiogram data 36 accurately represents theaudiogram; and a hearing device configuration component 51 arranged togenerate configuration data 52 and to communicate with the hearingdevice 18 in order to configure the hearing device 18 for a personaccording to the audiogram associated with the person.

In a variation, the functional components 30 may also include anaudiogram creation component 92 arranged to facilitate creation ofaudiogram data 36 for a person directly using the system 10 byimplementing a hearing test with the person using the hearing device 18,and without deriving the audiogram data 36 from an audiogram.

In order to implement the system 10 using the smartphone 14, aprospective user first downloads a software application associated withthe system from a suitable software repository onto the user'ssmartphone 14 and installs the software application on the smartphone14, the software application arranged to implement the functionalcomponents 30 shown in FIG. 3.

Referring to FIG. 4, a functional diagram 55 is shown illustrating thefunctional components 30 of the system 10 and interactions between thefunctional components 30 during operation of the system 10.

An example of the system 10 during use will now be described in relationto a smartphone 14, wherein data used by and generated by the system 10is stored in the data storage device 22 of the smartphone 14.

However, it will be understood that other arrangements are possible. Forexample, at least some data used by and produced by the system 10 may beobtained from or stored remotely from the smartphone 14. In an exampleimplementation 60 shown in FIG. 5, multiple computing devices, in thisexample multiple smartphones 14, communicate through a network such asthe Internet 62 with a remote server 64 in order to store configurationdata 52 associated with audiograms. In this way, the configuration data52 particular to each person associated with the system is stored in acommon accessible location so that the relevant current configurationdata can be obtained and used to configure or reconfigure a hearingdevice 18 using any computing device.

An example audiogram 12 is shown in FIG. 6.

An audiogram 12 is a representation of characteristics of a person'shearing ability, in this example in visual form, and includes afrequency x-axis 66, a hearing threshold level y-axis 68, a left ear airconduction plot 70 having left ear symbols 72, and a right ear airconduction plot 74 having right ear symbols 76. Each of the plots 70, 74represents the air conduction hearing characteristics of an ear of aperson at particular frequencies, in this example at 125 Hz, 250 Hz, 500Hz, 1 kHz, 2 kHz, 4 kHz and 8 kHz, in terms of hearing thresholds of theperson at the particular frequencies. The audiogram 12 also includesleft ear bone conduction symbols 75 and right ear bone conductionsymbols 77 that represent the bone conduction hearing characteristics ofears of a person at particular frequencies, in this example at 250 Hz,500 Hz, 1 kHz, 2 kHz and 4 kHz. An audiogram typically uses red ‘0’symbols for right ear air conduction hearing thresholds, blue ‘X’symbols for left ear air conduction hearing thresholds, ‘[’ symbols forright ear bone conduction hearing thresholds, and ‘]’ symbols left earbone conduction hearing thresholds, although it will be understood thatother colours and symbols may be used to represent these or otherthresholds or information present on the audiogram.

In the example audiogram 12 shown in FIG. 6, the person has abnormalhearing in both left and right ears at frequencies above 500 Hz, andtherefore the person represented in the audiogram 12 would benefit fromsome hearing assistance that could be provided by a hearing device 18appropriately configured for the person's hearing capabilities.

In an example during use a person has obtained an audiogram 12 from ahealth professional that represents the hearing capabilities of theperson, and in particular any hearing difficulties that the person has,and the person wishes to program his/her hearing device 18 according tothe hearing characteristics defined in the audiogram 12.

Referring to FIG. 4, the person first captures the audiogram 12, in thisexample using the camera 16 of the person's smartphone 14. In thisexample, the audiogram 12 is printed on paper and capture of an image ofthe audiogram 12 is achieved using the smartphone 14 by aligning theprinted audiogram 12 with an image capture frame 80 using conventionaltouch Inputs including zoom and rotate touch gestures. Image capture isimplemented using the audiogram capturing component 32 according to oneor more associated processes stored in the data storage device 22.

In an alternative embodiment, the system is arranged to receive imagedata indicative of an audiogram through a communications link, forexample using USB, Bluetooth or Wi-Fi protocols. In this way, the imagedata indicative of an audiogram may be captured by the system byimporting the image data over a network or by importing the to imagedata from a portable data storage device such as a USB drive.

After capture of the audiogram 12, the audiogram is processed by theaudiogram processing component 34 in order to recognise relevant hearingcharacteristic data in the audiogram 12 and produce audiogram data 36that is indicative of the hearing characteristics of the personassociated with the audiogram 12, in particular the hearing thresholdlevels at specific frequencies. The audiogram processing component 34implements one or more audiogram processes 38 in order to obtain theaudiogram data 36 from the audiogram image, for example a templatematching and phase correlation process to identify the positions andlocations of the left and right ear symbols in the audiogram image andthe x-axis and y-axis scales, and a translation process to translate theaudiogram image into the audiogram data 36. The audiogram processes 38may use recognition reference data 40 stored in the data storage device22 that for example represents reference audiograms for which audiogramdata is known.

Template matching may be performed by creating templates for airconduction hearing threshold markers, bone conduction hearing thresholdmarkers and other symbols found in a typical audiogram, such as thosespecified in ANSI standard S3.21. In this example, templates are formedfor X, O, [ and] symbols representing the hearing thresholds in theaudiogram. A further template is also created for the grid structureused in the audiogram.

Optical character recognition or template matching to character symbolsrepresenting the dB scale may be used to determine reference points fordB levels in the audiogram data. Similarly, optical characterrecognition or template matching to character symbols representing thefrequency scale may be used to determine reference points for frequencypoints in the audiogram image.

The templates are convolved with the audiogram image at all possiblepixel locations in the image, and the result compared to a threshold todetermine the likely location of the symbols in the image. This isrepeated for all templates to identify the location of the gridstructure, the air conduction hearing thresholds and the bone conductionthresholds. Further this process can also be repeated to determine thelocation of dB markings and frequency markings in the audiogram image.

After the locations of the relevant items on the audiogram image havebeen identified, the audiogram image data can be translated to audiogramdata.

The audiogram processes 38 may employ other techniques, includingsupport vector machines or artificial neural networks that userecognition reference data 40 as training data for the neural network.In an example, the training data consists of many, typically 1000 ormore, audiogram images with corresponding audiogram data 36 that hasbeen generated by a human operator. The training data is used to developmodels that can then be used by the audiogram processing component 34 togenerate the audiogram data 36.

The audiogram data 36 may be indicative of numerical data thatidentifies a hearing threshold in dB at specific frequencies 125 Hz, 250Hz, 500 Hz, 1 kHz, 1.5 kHz, 2 kHz, 3 kHz, 4 kHz, 6 kHz and 8 kHz, withthe hearing thresholds identified between 0 dB and 120 dB in 5 dBIncrements.

The audiogram 12 may also indicate bone conduction measurements, airconduction measurements, masked measurements or other measurements (notshown) that can also be identified by the audiogram capturing component32 and included in the audiogram data 36 for analysis by the audiogramprocessing component 34. This would allow for more accurate tuning ofthe hearing device for hearing assistance purposes.

In addition, the present system 10 is also arranged to enable audiogramdata to be obtained directly from a person using the hearing device 18.

In this embodiment, the audiogram data 36 may be processed by theaudiogram data analysis component 42 so as to compare the audiogram datawith a database of existing audiogram reference data 44, and createhearing analysis information 46 on the basis of the comparison, forexample for storage in the data storage device 22. The hearing analysisinformation 46 may provide the person associated with the audiogram data36 with an indication as to whether the audiogram data 36 is suggestiveof a hearing problem.

For example, the audiogram data analysis component 42 may compare theaudiogram data 36 currently obtained from a person with referenceaudiogram data 44, for example indicative of specific hearing or othermedical conditions. Alternatively, the audiogram data analysis component42 may compare the audiogram data 36 currently obtained from the personwith previously produced audiogram data 44 for the person in order todetermine trends in the person's hearing, such as whether significanthearing loss has occurred; whether significant hearing loss has occurredin one ear compared to the other ear; whether a sudden onset of hearingloss, a rapidly progressing hearing loss or conductive hearing loss hasoccurred; and so on.

The system may also be arranged to receive vertigo information from auser indicative that the user suffers from vertigo and to use thevertigo information and the audiogram data to diagnose a medicalcondition associated with the user's ears.

If the system determines that a medical problem may be present, thesystem may be arranged to generate an alert to a user, for example inthe form of a visible and/or audible alert.

In this embodiment, the audiogram data 36 may be used by the audiogramvalidation component 48 to validate the audiogram data 36 with theperson associated with the audiogram data 36 by communicating with thehearing device 18 to play tones at levels based on the hearingthresholds defined in the audiogram data 36. For example, the system 10may cause the hearing device 18 to play tones at or close to the hearingthresholds defined in the audiogram data 36. The person is then requiredto indicate if the tone has been heard, for example using the touchscreen to provide a user input 56 or by performing a gesture that isvisually recognised by the system. If no tone is heard at a hearingthreshold defined in the audiogram data 36, this may indicate that theaudiogram data 36 has been incorrectly generated from the audiogramimage or the audiogram itself should be updated by carrying out a newhearing test. The test may use the Hughson-Westlake procedure or themodified Hughson-Westlake procedure, with a starting hearing thresholdset at an additional 15 dB starting intensity level. If the results ofthe validation do not align to the audiogram data 36, for example within+/−10 dB, then the system may be arranged to generate an alert, forexample displayed on the display 26 of the smartphone 14.

In this embodiment, the person has an opportunity to edit the audiogramdata 36 produced by the audiogram processing component 34, for exampleif required in order to correct an error in the audiogram process(es) 38carried out by the audiogram processing component 34.

For example, as shown in FIG. 8, a person may view a visualrepresentation of the audiogram data 36 and interact with the visualrepresentation in order to move one or more left and/or right symbols ifone or more of the symbols are incorrectly located. The person may forexample interact with the visual representation using a finger 82, andmay for example correct a symbol location by touching the incorrectsymbol location and moving the symbol to a correct location in thedirection of one of the arrows 84. In this example, a decibel indicator86 is also provided to visually display the current location in decibelsof a symbol touched by the person.

Using the audiogram data 36, the hearing device configuration component51 applies one or more configuration processes 54, for example stored inthe data storage device 22, to the audiogram data 36 to produceconfiguration data 52 usable by the hearing device 18 to program thehearing device and thereby improve the hearing of the person.

Additional configuration information may be required in order toconfigure the hearing device 18, including information indicative of theage and sex of the person, whether the person is an experienced hearingdevice user, and/or the primary language of the hearing device user. Theadditional configuration information may be received from a person, forexample the intended user of the hearing device 18.

The configuration processes may include processes arranged to useformulae NAL-R, NAL-NL1, NAL-NL2 or other processes such as DSLv5 togenerate hearing device configuration data 52 from the audiogram data36, or any other process suitable to produce configuration data 52 fromthe audiogram data 36. The hearing device configuration component 51 mayalso produce configuration data 52 in consideration of the performancecapabilities of the hearing device 18.

For example, for the audiogram example shown in FIG. 6, the audiogramprocessing component 34 generates audiogram data 36 as shown in Table 1below.

TABLE 1 Left Air Right Air Conduction Conduction Frequency/Hz ThresholdThreshold 125 20 10 250 15 20 500 20 30 1000 30 30 2000 50 40 4000 60 508000 55 65

For example, using a NAL-R prescription formula the audiogram data canthen be translated into hearing device configuration data correspondingto frequency bands 250 Hz, 500 Hz, 1000 Hz, 2000 Hz and 4000 Hz, asshown in Table 2 below.

TABLE 2 Left Ear Right Frequency/Hz Gain Ear Gain 250 −7.35 −5.8 500 3.26.3 1000 15.3 15.3 2000 19.5 16.4 4000 21.6 18.5

The NAL-R formula is:

H _(3FA)=(H _(5C0) +H _(1k) +H _(2k))/3

X=0.15H _(3FA)

IG_(i) =X+0.31H _(i) +k _(i)

where H_(i) is a hearing threshold value specified in the audiogram data36, IG_(i) is the gain value (‘insertion gain’) used to program thehearing device 18, and k_(i) is determined according to Table 3.

TABLE 3 Frequency/Hz K_(i)/dB 250 −17 500 −8 1000 1 2000 −1 3000 −2 4000−2 6000 −2

The performance capabilities of the hearing device 18 may be obtained byquerying the device for its capabilities, or by obtaining thecapabilities from a local 90 or remote (not shown) hearing devicedatabase, for example connected in networked communication with thesystem 10. In a variation, the system may be arranged to query thehearing device 18 in order to obtain Identification informationindicative of the type of hearing device 18, such as a serial number ofthe hearing device 18, and to use the Identification information toretrieve the device capabilities associated with the hearing device 18,for example from a local or remote storage device.

Such device capabilities may include device frequency range, maximumgain, type of ear tip fitted and whether the heating device is an openor closed fit device. The hearing device capabilities may also beentered manually.

Communication between the smartphone 14 and the hearing device 18 canoccur through a common communication established using a wired orwireless connection that may use Bluetooth, Wi-Fi or USB protocols.

Using the communication link between the smartphone 14 and the hearingdevice 18, the system is able to configure the hearing device 18according to the configuration data 52 produced for the person.

The communication link may also be used to query the hearing device 18for device capabilities or status information, and allows transmissionof current configuration data stored on the hearing device 18 from thehearing device 18 to the smartphone 14 in order to allow theconfiguration data to be reviewed and modified as required. Theconfiguration data obtained from the hearing device 18 may be stored onthe smartphone 14.

The communication link may also be used to obtain hearing devicespecific information, such as the serial number associated with thehearing device.

The system 10 may also be arranged to allow a person to fine tune theconfiguration of the hearing device 18 by modifying the configurationdata 52 either directly or indirectly. Such modifications may be carriedout while the hearing device 18 is being worn, and the wearer mayprovide verbal feedback, touch feedback or otherwise.

Information indicative of the modification(s) may then be displayed onthe display 26 of the smartphone 14. The system may also provide audiblefeedback through the hearing device 18 or a separate speaker.

Fine tuning may include modification of a gain, feedback response,frequency response, compression parameters or any other configurationparameter associated with the hearing device 18. During fine tuning, thehearing device configuration data may be updated on the hearing device18 in a live manner so that the wearer of the hearing device 18 can hearchanges as they are being made. After confirming that the modificationsare acceptable, the hearing device configuration component 51 updatesthe configuration data 52 stored at the smartphone 14 and on the hearingdevice 18.

The hearing device 18 may also store data and usage statistics such asenvironmental information or listening situations in which the hearingdevice 18 has been used.

In addition to deriving audiogram data 36 from an image of an audiogram,the audiogram data 36 may be obtained for a person by performing ahearing assessment on the person using the hearing device 18. Forexample, if an audiogram for the person is not available, or at theelection of the user, the following hearing assessment process may beimplemented using the audiogram creation component 92.

Initially, the person may be directed to wear the hearing device 18, forexample by providing an audible or visible prompt to the person. Theaudiogram creation component 92 then interacts with the hearing device18 to undertake a hearing assessment, for example a Hughson-Westlakeprocess or a Modified Hughson-Westlake process, to measure hearingthreshold data associated with the user by causing the hearing device 18to generate sounds of particular frequencies and monitoring responses tothe sounds, for example received using the touch screen 28.

The Hughson-Westlake process and Modified Hughson-Westlake process canbe time consuming and require a person's attention and concentration forextended periods of time. The time required to complete the process canbe significantly reduced by only obtaining hearing threshold datarelevant to the capabilities of the audio device 18. For example, theprocess may be modified to only present audio tones corresponding tohearing thresholds consistent with the audio device fitting range. Audiotones should however also be presented that correspond to hearingthresholds outside of the device fitting range, for examplecorresponding to +/−10 dB.

The Hughson-Westlake process and Modified Hughson-Westlake process canbe administered in an automatic programmatic way by the audiogramcreation component 92 by causing the hearing device 18 to present audiostimuli and monitoring user feedback that indicates whether the audiostimuli have been heard.

In this example, the audiogram creation component 92 is arranged to testfor hearing threshold levels at frequency points 125 Hz, 250 Hz, 500 Hz,1000 Hz, 1500 Hz, 2000 Hz, 3000 Hz, 4000 Hz, 6000 Hz and 8000 Hz,although it will be understood that any suitable frequency points areenvisaged. For example, the number of frequency points can be reduced ifa shorter test is desired, such that only frequency points 500 Hz, 1000Hz, 2000 Hz and 4000 Hz are used.

Also in this example, the audiogram creation component 92 is arranged toincrease the audio stimuli at 5 dB increments, although it will beunderstood that any suitable increment is envisaged.

The process may require the user's better ear to be assessed first, forexample determined according to user input. If no better ear isindicated, the left ear may be assessed first.

An example of an arrangement for performing a hearing assessment on aperson using the hearing device 18 will now be described with referenceto FIGS. 9 to 25. The hearing assessment is carried out directly usingthe hearing device 18 under control of the computing device, in thisexample a smartphone 14. It will be understood that in order to providethe required functionality on the smartphone 14, a dedicated softwareapplication is Installed on the smartphone 14, for example obtained froman online software repository. The software application may be part ofthe software application arranged to implement the functional components30 shown in FIG. 3 or may be a separate application.

In this example, the hearing device 18 is operable in 3 modes:

-   -   a normal mode wherein the hearing device 18 is arranged to        enhance hearing, receive streamed audio from a computing device        such as a smartphone, and operate as a wireless headset for        telephony;    -   a fitting mode wherein sounds are presented to the user and an        assessment is made as to whether left and right hearing devices        are properly fitted into the users ears; and    -   a hearing assessment mode wherein a hearing assessment is        carried out by the left and right hearing devices with the        computing device, in this example the smartphone 14.

During the fitting mode and the hearing assessment mode, the hearingdevice 18 does not allow reception of incoming calls, user input fromcontrols on the hearing device 18, or reception of streamed audio, suchas music, from the computing device 14. In addition, while sound frommicrophones on the hearing device may be processed, the sound receivedat the microphones is not reproduced by the hearing device speakersduring the fitting mode and the hearing assessment mode.

In the present embodiment, the hearing device 18 is arranged to remainin fitting mode or hearing assessment mode while a hearing assessmentprocess is active, and in this example the smartphone 14 is arranged torepeatedly poll the left and right hearing devices 18 while the hearingassessment application on the smartphone 14 is active. If the hearingdevices 18 do not receive a poll communication from the smartphone 14after a defined period of time, the hearing devices 18 are arranged toswitch back to normal mode as, for example, it is assumed that thesmartphone application has been closed.

Referring to FIG. 9, functional components 100 of the hearing device 18are shown schematically.

The functional components 100 include a processor 102 arranged tocontrol and coordinate operations in the hearing device 18, and avolatile memory 103 used by the processor to implement programsassociated with functionality of the hearing device 18.

The functional components 100 also include a wireless communicationsunit 104 arranged to facilitate wireless communication to and from thehearing device, in particular between the hearing device 18 and acomputing device such as a smartphone 14. In this example, the wirelesscommunications unit 104 is arranged to support Bluetooth communications,Bluetooth low energy communications and/or WiFi communications, althoughit will be understood that any suitable communications protocol isenvisaged.

In an embodiment, the smartphone 14 is arranged to communicate with bothleft and right hearing devices 18. Alternatively, the smartphone 14 isarranged to communicate with one of the left and right hearing devices18 as a master hearing device, with the master hearing devicecommunicating directly with the other hearing device as a slave hearingdevice.

The functional components 100 also include several, in this example 2,microphones 106, each microphone 106 having an associated amplifier 107and analogue to digital converter 108. The microphones 106 are arrangedto receive sound information associated with the ambient environment andfor example the system may use the received sound information todetermine the ambient noise level.

The functional components 100 also include a speaker 110 having anassociated amplifier 111 and digital to analogue converter 112. Thespeaker 110 is arranged to produce sound corresponding to soundinformation provided by the processor 102. In this example, during ahearing assessment, the sound may comprise tones including a pure tone,a pulsed tone, a warble tone, a pulsed warble tone, band limited noiseor any other suitable sound for use during a hearing assessment.

The functional components 100 also include a user input device 114arranged to facilitate reception of input commands directly from awearer of the hearing device 18, and a non-volatile memory 116 arrangedto store programs for use by the processor 102 to implement desiredfunctionality. The non-volatile memory 116 also stores audiogram datacreated as a result of carrying out hearing tests as hearing thresholddata 118.

The functional components 100 also include a sound generator 120arranged to generate sound information usable by the digital to analogueconverter 112, the amplifier 111 and the speaker 110 to produce sound.In this example, the processor 102 and sound generator 120 areresponsive to commands received by the hearing device 18 from acomputing device such as a smartphone 14, such that a received commandis interpreted by the processor 102 and the sound generator 120, andsound information produced that is usable by the digital to analogueconverter 112, the amplifier 111 and the speaker 110 to create soundcorresponding to the sound information. In this way, the system ensuresthat the sound is generated at the hearing device 18 thereby ensuringthat the generated sound is a faithful representation of the desiredsound, for example in terms of level and frequency. Calibrationinformation 122 is used to ensure that the sound presented to a wearerof the hearing device 18 is at a level and frequency that accuratelycorresponds to the desired level and frequency.

A command sent by the computing device 14 to the hearing device 18 mayuse any suitable format. For example, a command may contain thefollowing information:

[Command ID] [Side (0=Left, 1=Right, 2=Left & Right)] [Type(0=Continuous, 1=Pulsed)] [Frequency (in Hz)]

[Duration (in seconds)][Level (dB)]

In an alternative arrangement, the sound information corresponding tothe desired sounds may be generated on the computing device and streamedto the hearing device 18 for production by the speaker 110. However,with this arrangement, there is a possibility that the computing devicewill modify the level of the sound because the computing device, forexample a smart phone, typically does not have full control over thelevel of sound sent to the hearing device 18.

In response to generation of a sound at the hearing device, the wearertypically responds by providing an input, such as a touch gesture, onthe computing device to indicate that the sound has been heard. If aresponse to a sound is not received from a wearer of the hearing device18, the system is arranged to record threshold information to indicatethe minimum level of sound that the wearer is able to hear at therelevant frequency. In this way, the system creates hearing thresholddata representative of hearing thresholds at a plurality of frequenciesthat is representative of an audiogram for the wearer.

In this example, the functional components 100 also include a noiseassessment module 124 arranged to assess the level of background ambientnoise and determine whether it is possible to carry out a hearingassessment based on the detected level of background noise. In thisexample, the noise assessment module 124 uses sound received from themicrophones 106 on the hearing device 18 as in this way an accuratereading of the level of ambient sound adjacent ears of the user can beobtained.

The functional components also Include an identification module 126arranged to provide identification Information on request, for examplebased on a request from the smartphone 14, the identificationInformation indicative of the type of hearing device.

An example hearing assessment procedure carried out by the computingdevice, in this example a smartphone 14, and the hearing device 18 isillustrated in FIGS. 10 to 25 with reference to example screensdisplayed to a user on the smartphone 14.

A hearing assessment is instigated by implementing the relevant softwareapplication on the smartphone 14, and after commencement of a hearingassessment procedure using the smartphone application, the smartphone 14sends a communication to the hearing devices 18 that causes the hearingdevices 18 to switch from normal mode to a fitting mode. In the fittingmode, a background noise screen 130 is displayed on the smartphone 14,as shown in FIGS. 10 and 11.

The background noise screen 130 includes a background noise Indicator132 arranged to communicate to a user whether the background noise istoo high to carry out an effective hearing assessment. In this example,for this purpose, the background noise indicator 132 includes anacceptable background noise line 134 and a current noise indicator 136,in this example in the form of a sector the central angle of which isrepresentative of the noise level. As shown in FIG. 10, a sector havinga central angle that is less than an angle associated with theacceptable background noise line 134 corresponds to an acceptablebackground noise level. As shown in FIG. 11, a sector having a centralangle that is greater than an angle associated with the acceptablebackground noise line 134 corresponds to an unacceptable backgroundnoise level. The acceptable and unacceptable background noise levels maybe further communicated to a user by displaying the associated segmentsin different colours.

The next stage of the example hearing assessment procedure is to displayan ear selection screen 140, as shown in FIGS. 12 and 13.

The ear selection screen 140 includes ear selectors 142 usable to enablea user to select that ear that is considered to provide better hearing,or to indicate that the user has no preferred ear. Selection of an earcauses a selected ear indicator 144 to highlight the selected ear, asshown in FIG. 13.

The next stage of the example hearing assessment procedure is toimplement a familiarization procedure whereby a user is provided withexamples of the sounds that will be presented to the user during thehearing assessment, and the user undergoes a fitting procedure wherebyan assessment is made as to whether left and right hearing 3 t) devices18 are properly fitted into the user's ears. If a hearing device 18 isnot properly fitted into a users ear, leakage of low frequency sound canoccur and the sound may not effectively couple to the ear to the extentthat the user cannot hear the sound.

During the familiarization procedure, a familiarization screen 150, asshown in FIGS. 14 and 15, is displayed. Using the familiarization screen150, one or more sound tones are generated at the hearing device 18corresponding to the selected ear, or if no ear has been selected,corresponding to the right ear. The familiarization procedure iscommenced by selecting a start button 152, and in response to hearingthe or each sound the user presses a response button 154 to Indicatethat the tone has been heard.

In this example, the tone played during the familiarization proceduremay be a low level low frequency tone that may be a 1 kHz tone at 60dBHL, a 250 Hz tone at 70 dBHL, and/or a 250 Hz tone at 40 dBHL. Thetone may be a continuous tone, a pulsed tone or a pulsed warble tone.

If the user does not respond to indicate that one or more of the toneshave been heard, an ear tip screen 156 is displayed, as shown in FIG.16. The ear tip screen 156 is used to advise the user that the relevanthearing device 18 may not be properly fitted in the user's ear andadjustment may be required, for example by modifying an ear tip used onthe hearing device 18.

After appropriate modification of the location of the hearing device inthe user's ear or replacement of the ear tip of the hearing device 18,if a response is not received to indicate that the tone has been heard,a heartbeat screen 160 is displayed, as shown in FIG. 17. At theheartbeat screen 160, the user selects the relevant ear using an earselector 162 and the selected ear is highlighted by a selected earindicator 164. After selection of an ear, a heartbeat tone is producedat the relevant hearing device 18 corresponding to the selected ear. Theheartbeat tone is used because some people have difficulty identifyinglow frequency sounds, but people can usually identify a low frequencyheartbeat sound.

If the user has responded to Indicate that either the familiarizationtone or the heartbeat tone has been heard, a fitting complete screen isdisplayed, as shown in FIG. 18 to provide the user with confirmationthat the left and right hearing devices 18 appear to be well fitted.

After completion of the familiarization procedure, the hearing devicesswitch to a hearing assessment mode and a test start screen 168, asshown in FIG. 19 is displayed on the smartphone 14. The hearing test iscommenced by selecting a test start button 170 on the test start screen168.

During the hearing test, a test response screen 180 is displayed asshown in FIGS. 20 and 21, and successive tones are produced for each earin turn, for example according to the Hughson-Westlake process orModified Hughson-Westlake process.

In this example, the tones are produced at frequency points 125 Hz, 250Hz, 500 Hz, 1000 Hz, 1500 Hz, 2000 Hz, 3000 Hz, 4000 Hz, 6000 Hz and8000 Hz, although it will be understood that any suitable frequencypoints are envisaged. For example, the number of frequency points can bereduced if a shorter test is desired, such that only frequency points500 Hz, 1000 Hz, 2000 Hz, 3000 Hz, 4000 Hz and 6000 Hz are used. Duringthe test, the level of each tone is increased at 5 dB increments,although it will be understood that any suitable increment is envisaged.

In this example, the tones are pulsed warble tones with a fundamentalfrequency corresponding to the frequency points according to theHughson-Westlake process or Modified Hughson-Westlake process.

In response to each tone, if the tone has been heard by the user, theuser presses a response button 182. Progress through the test iscommunicated to the user using a test progress indicator 184.

After completion of the hearing test, a test complete screen 186 isdisplayed, as shown in FIG. 22, to indicate to the user that the testhas finished.

After completion of the hearing test, an age selection screen 190 asshown in FIG. 23 and a gender selection screen 196 as shown in FIG. 24are displayed. Using the age selection screen 190, the user entershis/her age using an age field 192 and number pad 194. Using the genderselection screen 196, the user enters his/her gender using genderselections buttons 198. The age and gender of the user are required asan assessment of the hearing capabilities of the user is dependent onthe age and gender of the user.

As shown in FIG. 25, a test results screen 200 is then displayed thatshows the user's hearing results using a hearing results indicator 202.

In this example, the hearing results indicator 202 includes a left earportion and a right ear portion, the right and left ear portionscorresponding to hemispheres of a circle. Each ear portion includesmultiple ring portions 204, 206. Each ring portion 204, 206 correspondsto a specific frequency point, for example of the Hughson-Westlakeprocess or Modified Hughson-Westlake process, with for example theinnermost ring portion corresponding to the lowest frequency point andthe ring portions outwardly of the innermost ring portion progressivelycorresponding to successively higher frequency points. In addition, thelength of each ring portion corresponds to the strength of hearing atthe frequency point associated with the ring portion. The ring portions204, 206 may be represented differently based on whether the ringportions 204, 206 are associated with the left or right ear, for exampleby displaying the ring portions 204, 206 in different colours, and maybe represented differently based on the relevant frequency, for exampleby displaying the ring portions 204, 206 for each ear in differentshades of the same colour.

The results indicator 202 shown in FIG. 25 indicates that the personconcerned has hearing loss and, in particular, has particular difficultyhearing at the highest frequency point of the Hughson-Westlake processor Modified Hughson-Westlake process used in the hearing assessment.

It will be understood that the results indicator 202 provides a simple,efficient mechanism for communicating the hearing characteristics of aperson for each separate ear in terms of strength of hearing atdifferent frequencies to a non-professional.

In addition to the functionality described above, or alternatively, asystem for configuring a hearing device may be provided that is arrangedto produce recommendation information indicative of a referral to ahearing health professional or other health professional or of arecommendation to use a different hearing device 18 that has greater ormore suitable capabilities, if the audiogram data indicates that amedical problem may exist, or that the hearing capabilities of the usermay not be adequately improved by the hearing device 18. Therecommendation information may be displayed to the user and/orelectronically communicated to one or more relevant people.

For this purpose, in an embodiment, the audiogram data analysiscomponent 42 may be arranged to consider the hearing devicecapabilities, for example retrieved from the hearing device database 90,with the audiogram data, and if the consideration indicates that theuser requires a hearing device with greater or different capabilitiesthan the current hearing device 18 can provide, a referral database 94is queried by the audiogram data analysis component 42 for a hearinghealth professional that satisfies defined criteria, for example basedon locality.

The consideration may be based on a comparison of the hearing thresholdsspecified in the audiogram data with the hearing device fitting range,and for example if the hearing thresholds are close to or outside anacceptable device fitting range, the audiogram data analysis component42 is arranged to make a determination that the user should be referred.

In an embodiment, the audiogram data analysis component 42 may bearranged to produce the recommendation information if the audiogram datais within 5 dB of the audio device fitting range limits, within 10 dB ofthe audio device fitting range limits, or within 15 dB of the audiodevice fitting range limits.

The audiogram data used to compare the hearing capabilities of the userwith the audio device capabilities may include air conduction hearingthresholds and bone conduction hearing threshold measurements.

In an example, the recommendation information may be produced and forexample displayed to the user if the bone conduction measurements arenot within 10 dB of the air conduction measurements.

The recommendation information may be produced if any frequency point inthe air conduction audiogram data is 0 dB, 5 dB, 10 dB, 15 dB of thedevice fitting range when compared on the frequency point by frequencypoint basis.

The system may be arranged to implement an automated referral processwherein the location of the user is determined, for example using a GPSdevice or other location determining device that may be present in thecomputing device or through an API, and the determined location used toextract relevant hearing health professional(s) from the referraldatabase 94. The closest hearing health professional recorded in thereferral database 94 can for example be determined using conventionalroute finding and mapping data APIs.

In an embodiment, multiple local hearing health professionals, such as 3local health professionals, are identified and for example displayed tothe user.

The system 10 may also be arranged to compare a users electroniccalendar with an electronic calendar of the identified hearing healthprofessional(s), for example stored in an accessible database such asthe referral database 94 so that a mutually free timeslot for the userand the hearing health professional can be identified. The user'selectronic calendar may be retrieved using an API on the user'ssmartphone.

It is to be understood that, if any prior art publication is referred toherein, such reference does not constitute an admission that thepublication forms a part of the common general knowledge in the art, inAustralia or any other country.

In the claims which follow and in the preceding description of theinvention, except where the context requires otherwise due to expresslanguage or necessary implication, the word “comprise” or variationssuch as “comprises” or “comprising” is used in an inclusive sense, i.e.to specify the presence of the stated features but not to preclude thepresence or addition of further features in various embodiments of theinvention.

Modifications and variations as would be apparent to a skilled addresseeare determined to be within the scope of the present invention.

The claims defining the invention are as follows:
 1. A system forconfiguring a hearing device, the system comprising: an audiogramprocessing component arranged to process image data indicative of animage of an audiogram associated with a person so as to produceaudiogram data indicative of the audiogram; and a hearing deviceconfiguration component arranged to produce hearing device configurationdata based on the audiogram data, the configuration data indicative ofconfiguration settings for a hearing device that will cause the hearingdevice to assist the hearing of the person.
 2. A system as claimed inclaim 1, comprising a camera arranged to capture image data indicativeof an audiogram.
 3. A system as claimed in claim 2, wherein the systemis arranged to enable a user to align an audiogram with an image captureframe in order to capture the image data indicative of the audiogram. 4.A system as claimed in claim 3, wherein the system is arranged to enablea user to align an audiogram with an image capture frame using gestures.5. A system as claimed in any one of the preceding claims, wherein thesystem is arranged to receive image data indicative of an audiogramthrough a communications link.
 6. A system as claimed in claim 5,wherein the communications link uses a USB, Bluetooth or Wi-Fi protocol.7. A system as claimed in any one of the preceding claims, wherein thesystem is arranged to obtain air conduction measurements from theaudiogram and to include data indicative of the air conductionmeasurements in the audiogram data.
 8. A system as claimed in any one ofthe preceding claims, wherein the system is arranged to obtain boneconduction measurements from the audiogram and to include dataindicative of the bone conduction measurements in the audiogram data. 9.A system as claimed in any one of the preceding claims, wherein theaudiogram processing component is arranged to process image dataindicative of an image of an audiogram so as to produce audiogram dataindicative of the audiogram using a template matching process.
 10. Asystem as claimed in any one of the preceding claims, wherein theaudiogram processing component is arranged to process image dataindicative of an image of an audiogram so as to produce audiogram dataindicative of the audiogram using support vector machines.
 11. A systemas claimed in any one of the preceding claims, wherein the audiogramprocessing component is arranged to process image data indicative of animage of an audiogram so as to produce audiogram data indicative of theaudiogram using at least one neural network.
 12. A system as claimed inany one of the preceding claims, wherein the hearing deviceconfiguration component is arranged to use formulae NAL-R, NAL-NL1 orNAL-NL2 to produce the hearing device configuration data from theaudiogram data.
 13. A system as claimed in any one of the precedingclaims, wherein the hearing device configuration component is arrangedto use configuration information indicative of the age and sex of aperson, whether the person is an experienced hearing device user, and/orthe primary language of the person to produce the hearing deviceconfiguration data from the audiogram data.
 14. A system as claimed inany one of the preceding claims, wherein the hearing deviceconfiguration component is arranged to produce configuration data inconsideration of the device capabilities of the hearing device.
 15. Asystem as claimed in claim 14, wherein the system is arranged to querythe hearing device for the device capabilities.
 16. A system as claimedin claim 14, wherein the system is arranged to enable an operator tomanually enter the device capabilities.
 17. A system as claimed in claim14, wherein the system is arranged to retrieve device capabilitiesassociated with the hearing device from a storage device.
 18. A systemas claimed in claim 17, wherein the system includes the storage device.19. A system as claimed in claim 17, wherein the storage device is innetworked communication with the system such that the storage device isaccessible by the system through a network.
 20. A system as claimed inany one of claims 17 to 19, wherein the system is arranged to query thehearing device in order to obtain identification information indicativeof the type of hearing device, and to use the identification informationto retrieve the device capabilities associated with the hearing devicefrom the storage device.
 21. A system as claimed in any one of claims 14to 20, wherein the device capabilities include device frequency range,maximum gain, type of ear tip fitted and/or whether the hearing deviceis an open or closed fit device.
 22. A system as claimed in any one ofthe preceding claims, wherein the system is arranged to communicatewirelessly with a hearing device.
 23. A system as claimed in any one ofthe preceding claims, wherein the system comprises a computing devicearranged to: implement the audiogram processing component and thehearing device configuration component; and communicate with the hearingdevice.
 24. A system as claimed in claim 23, wherein the system isarranged to enable the computing device to download a softwareapplication arranged to implement the system when the softwareapplication is installed on the computing device.
 25. A system asclaimed in claim 23 or claim 24, wherein the computing device is asmartphone.
 26. A system as claimed in any one of the preceding claims,wherein the system is arranged to analyze the audiogram data todetermine whether the audiogram data is representative of a medicalcondition.
 27. A system as claimed in claim 26, wherein the system isarranged to process the audiogram data so as to compare the audiogramdata with audiogram reference data, and create hearing analysisinformation based on the comparison, the hearing analysis informationindicative of whether the audiogram data is suggestive of a hearingproblem.
 28. A system as claimed in any one of the preceding claims,wherein the audiogram reference data is indicative of audiogram datapreviously obtained from the person, the system using the comparisonbetween the audiogram data and the audiogram data previously obtainedfrom the person in order to determine at least one trend in the person'shearing.
 29. A system as claimed in claim 28, wherein the at least onetrend includes whether significant hearing loss has occurred; whethersignificant hearing loss has occurred in one ear compared to the otherear; or whether a sudden onset of hearing loss, a rapidly progressinghearing loss or conductive hearing loss has occurred.
 30. A system asclaimed in any one of claims 26 to 29, wherein the system is arranged toreceive vertigo information from a user indicative that the user suffersfrom vertigo and to use the vertigo information and the audiogram datato diagnose a medical condition associated with the user's ears.
 31. Asystem as claimed in any one of claims 26 to 30, wherein the system isarranged to generate an alert to a user if the system determines thatthe audiogram data is representative of a medical condition that mayrequire treatment.
 32. A system as claimed in any one of the precedingclaims, wherein the system is arranged to validate the audiogram data bycommunicating with the hearing device to generate tones at levels basedon the hearing thresholds defined in the audiogram data, and receiving aresponse from a person when the person has heard the tone.
 33. A systemas claimed in any one of the preceding claims, wherein the system isarranged to obtain audiogram data directly from a person by performing ahearing assessment on the person using the hearing device.
 34. A systemas claimed in claim 33, wherein the hearing assessment includes aHughson-Westlake process or a Modified Hughson-Westlake process and thesystem is arranged to cause the hearing device to generate tones ofdefined frequencies and to monitor responses from the person.
 35. Asystem as claimed in claim 34, wherein the system is arranged togenerate audio tones corresponding to hearing thresholds consistent withthe capabilities of the hearing device.
 36. A system as claimed in anyone of claims 33 to 35, wherein the system includes at least one hearingdevice.
 37. A system as claimed in claim 36, wherein the hearing deviceis operable in a normal mode wherein the hearing device is arranged toenhance hearing, receive streamed audio, and/or operate as a wirelessheadset for telephony.
 38. A system as claimed in claim 36 or claim 37,wherein the hearing device is operable in a fitting mode wherein anassessment is made as to whether a hearing device is properly fittedinto a user's ear.
 39. A system as claimed in claim 38, wherein, duringa fitting mode, the system is arranged to generate a low frequency toneand to assess whether the hearing device is properly fitted into auser's ear by determining whether the user has heard the low frequencytone.
 40. A system as claimed in claim 39, wherein the low frequencytone is a continuous tone, a pulsed tone, a pulsed warble tone or aheartbeat tone.
 41. A system as claimed in any one of claims 36 to 40,wherein the hearing device is operable in a hearing assessment modewherein a hearing assessment is carried out on the person.
 42. A systemas claimed in claim 41 when dependent on claim 37, wherein the hearingdevice is arranged to remain in hearing assessment mode while a hearingassessment is active, and to switch to normal mode if a hearingassessment is inactive.
 43. A system as claimed in claim 42, wherein thesystem is arranged to repeatedly poll the hearing device, and thehearing device is arranged to switch to normal mode if a pollcommunication is not received after a defined period of time.
 44. Asystem as claimed in any one of claims 33 to 43, wherein the system isarranged such that during a hearing assessment, the hearing devicerestricts or prevents functionality of hearing device.
 45. A system asclaimed claim 44, wherein the system is arranged such that during ahearing assessment, the hearing device is arranged so as to not allowreception of incoming calls, user input from controls on the hearingdevice, and/or reception of streamed audio.
 46. A system as claimed inany one of claims 33 to 45, wherein during a hearing assessment, a puretone, a pulsed tone, a warble tone, a pulsed warble tone or a band noiseis produced.
 47. A system as claimed in any one of claims 33 to 46,wherein the hearing device is arranged to assess the level of backgroundambient noise and determine whether the level of background ambientnoise is sufficiently low to carry out a hearing assessment.
 48. Asystem as claimed in any one of claims 33 to 47, wherein, during ahearing assessment, the system is arranged to generate sound generationcommands and to send the sound generation commands to the hearingdevice, each sound generation command usable by the hearing device tocreate sound associated with the command.
 49. A system as claimed in anyone of claims 33 to 47, wherein, during a hearing assessment, the systemis arranged to stream sounds to the hearing device.
 50. A system asclaimed in any one of the preceding claims, wherein the system isarranged to display a hearing results indicator, the hearing resultsindicator communicating graphically the hearing characteristics of aperson associated with audiogram data.
 51. A system as claimed in claim50, wherein the hearing results indicator includes a left ear portionincluding graphical information associated with hearing capabilities ofthe person in a left ear, and a right ear portion including graphicalinformation associated with hearing capabilities of the person in aright ear.
 52. A system as claimed in claim 51, wherein each ear portionincludes multiple concentric ring portions, each ring portioncorresponding to a different frequency in the hearing assessment.
 53. Asystem as claimed in claim 51 or claim 52, wherein the length of eachring portion corresponds to the strength of hearing at the frequencyassociated with the ring portion.
 54. A system as claimed in claim 52 orclaim 53, wherein the ring portions are represented differently based onwhether the ring portions are associated with the left or right ear. 55.A system as claimed in claim 52 or claim 53, wherein the ring portionsare represented differently based on the frequency.
 56. A system asclaimed in any one of the preceding claims, wherein the system isarranged to facilitate editing of the audiogram data.
 57. A system asclaimed in claim 56, wherein the system is arranged to display a visualrepresentation of the audiogram data, and to enable a person to modifythe visual representation and thereby the audiogram data.
 58. A systemas claimed in any one of the preceding claims, wherein the system isarranged to allow a person to modify the configuration data.
 59. Asystem as claimed in claim 58, wherein the modifications includemodification of a gain, feedback response, frequency response, orcompression parameter.
 60. A system as claimed in any claim 59, whereinthe hearing device configuration data is updatable on-the-fly so that awearer of the hearing device can hear changes as they are being made.61. A system as claimed in any one of the preceding claims, wherein thesystem is arranged to analyse the audiogram data to determine whether tocommunicate recommendation information to the person, the recommendationinformation indicative of a recommendation to carry out a hearingrelated action; the system arranged to communicate the recommendationinformation to the person if the determination is affirmative.
 62. Asystem as claimed in claim 61, wherein the recommendation information isindicative of a referral to a health professional.
 63. A system asclaimed in claim 62, wherein the audiogram data analysis component isarranged to retrieve the recommendation information from a referraldatabase.
 64. A system as claimed in claim 63, wherein the audiogramdata analysis component is arranged to retrieve the recommendationinformation based on defined criteria.
 65. A system as claimed in claim64, wherein the audiogram data analysis component is arranged toretrieve the recommendation information based on locality.
 66. A systemas claimed in claim 65, wherein the system includes a location devicearranged to produce location information indicative of the location ofthe system, and the system is arranged to use the location informationto select recommendation information indicative of a referral to ahealth professional based on the location of the professional.
 67. Asystem as claimed in any one of claims 60 to 65, wherein the system isarranged to compare a user's electronic calendar with an accessibleelectronic calendar of a selected hearing health professional so that amutually free timeslot for the user and the hearing health professionalcan be identified.
 68. A system as claimed in any one of claims 61 to67, wherein the audiogram data analysis component is arranged to analysethe audiogram data with reference to capabilities of a hearing deviceassociated with a person, and to determine whether the capabilities ofthe hearing device are suitable for the hearing capabilities of theperson defined in the audiogram data, and the system is arranged tocommunicate recommendation information indicative of a different hearingdevice if the different hearing device has more suitable capabilitiesthan the hearing device associated with the person.
 69. A system asclaimed in any one of claims 61 to 68, wherein the recommendationinformation may be displayed to the person and/or electronicallycommunicated to one or more relevant people.
 70. A method of configuringa hearing device, the method comprising: processing image dataindicative of an image of an audiogram associated with a person so as toproduce audiogram data indicative of the audiogram; and producinghearing device configuration data based on the audiogram data, theconfiguration data indicative of configuration settings for a hearingdevice that will cause the hearing device to assist the hearing of theperson.
 71. A method as claimed in claim 70, comprising capturing imagedata indicative of an audiogram using a camera.
 72. A method as claimedin claim 71, comprising enabling a user to align an audiogram with animage capture frame in order to capture the image data indicative of theaudiogram.
 73. A method as claimed in any one of claims 70 to 72,comprising receiving image data indicative of an audiogram through acommunications link.
 74. A method as claimed in any one of claims 70 to73, comprising obtaining air conduction measurements from the audiogramand including data indicative of the air conduction measurements in theaudiogram data.
 75. A method as claimed in any one of claims 70 to 74,comprising obtaining bone conduction measurements from the audiogram andincluding data indicative of the bone conduction measurements in theaudiogram data.
 76. A method as claimed in any one of claims 70 to 75,comprising processing image data indicative of an image of an audiogramso as to produce audiogram data indicative of the audiogram using atemplate matching process.
 77. A method as claimed in any one of claims70 to 76, comprising using configuration information indicative of theage and sex of a person, whether the person is an experienced hearingdevice user, and/or the primary language of the person to produce thehearing device configuration data from the audiogram data.
 78. A methodas claimed in any one of claims 70 to 77, comprising producingconfiguration data in consideration of device capabilities of thehearing device.
 79. A method as claimed in claim 78, comprising queryingthe hearing device for the device capabilities.
 80. A method as claimedin claim 78 or claim 79, comprising querying the hearing device in orderto obtain identification information indicative of the type of hearingdevice, and using the identification information to retrieve the devicecapabilities associated with the hearing device from a storage device.81. A method as claimed in any one of claims 70 to 80, comprisinganalyzing the audiogram data to determine whether the audiogram data isrepresentative of a medical condition.
 82. A method as claimed in claim81, comprising processing the audiogram data so as to compare theaudiogram data with audiogram reference data, and creating hearinganalysis information based on the comparison, the hearing analysisinformation indicative of whether the audiogram data is suggestive of ahearing problem.
 83. A method as claimed in claim 81 or claim 82,comprising receiving vertigo information from a user indicative that theuser suffers from vertigo and using the vertigo information and theaudiogram data to diagnose a medical condition associated with theuser's ears.
 84. A method as claimed in any one of claims 81 to 83,comprising generating an alert to a user if the method determines thatthe audiogram data is representative of a medical condition that mayrequire treatment.
 85. A method as claimed in any one of claims 70 to84, comprising validating the audiogram data by communicating with thehearing device to generate tones at levels based on the hearingthresholds defined in the audiogram data, and receiving a response froma person when the person has heard the tone.
 86. A method as claimed inany one of claims 70 to 85, comprising obtaining audiogram data directlyfrom a person by performing a hearing assessment on the person using thehearing device.
 87. A method as claimed in claim 86, wherein the hearingassessment includes a Hughson-Westlake process or a ModifiedHughson-Westlake process and the method comprises causing the hearingdevice to generate tones of defined frequencies and to monitor responsesfrom the person.
 88. A method as claimed in claim 87, comprisinggenerating audio tones corresponding to hearing thresholds consistentwith the capabilities of the hearing device.
 89. A method as claimed inclaim 88, wherein the hearing device is operable in a normal modewherein the hearing device is arranged to enhance hearing, receivestreamed audio, and/or operate as a wireless headset for telephony. 90.A method as claimed in claim 88 or claim 89, wherein the hearing deviceis operable in a fitting mode wherein an assessment is made as towhether a hearing device is properly fitted into a user's ear.
 91. Amethod as claimed in claim 90, wherein, during a fitting mode, themethod comprises generating a low frequency tone and assessing whetherthe hearing device is properly fitted into a user's ear by determiningwhether the user has heard the low frequency tone.
 92. A method asclaimed in claim 91, wherein the low frequency tone is a continuoustone, a pulsed tone, a pulsed warble tone or a heartbeat tone.
 93. Amethod as claimed in any one of claims 89 to 92, wherein the hearingdevice is operable in a hearing assessment mode wherein a hearingassessment is carried out on the person.
 94. A method as claimed inclaim 93 when dependent on claim 89, comprising maintaining the hearingdevice in hearing assessment mode while a hearing assessment is active,and switching to normal mode if a hearing assessment is inactive.
 95. Amethod as claimed in claim 94, comprising repeatedly polling the hearingdevice, and switching the hearing device to normal mode if a pollcommunication is not received after a defined period of time.
 96. Amethod as claimed in any one of claims 86 to 95, comprising restrictingor preventing functionality of hearing device during a hearingassessment.
 97. A method as claimed claim 96, comprising not allowingreception of incoming calls, user input from controls on the hearingdevice, and/or reception of streamed audio during a hearing assessment.98. A method as claimed in any one of claims 86 to 97, comprisingproducing a pure tone, a pulsed tone, a warble tone, a pulsed warbletone or a band noise during a hearing assessment.
 99. A method asclaimed in any one of claims 86 to 98, comprising assessing the level ofbackground ambient noise and determining whether the level of backgroundambient noise is sufficiently low to carry out a hearing assessment.100. A method as claimed in any one of claims 86 to 99, comprising,during a hearing assessment, generating sound generation commands andsending the sound generation commands to the hearing device, each soundgeneration command usable by the hearing device to create soundassociated with the command.
 101. A method as claimed in any one ofclaims 86 to 99, comprising, during a hearing assessment, streamingsounds to the hearing device.
 102. A method as claimed in any one ofclaims 70 to 101, comprising displaying a hearing results indicator, thehearing results indicator communicating graphically the hearingcharacteristics of a person associated with audiogram data.
 103. Amethod as claimed in claim 102, wherein the hearing results indicatorincludes a left ear portion including graphical information associatedwith hearing capabilities of the person in a left ear, and a right earportion including graphical information associated with hearingcapabilities of the person in a right ear.
 104. A method as claimed inclaim 103, wherein each ear portion includes multiple concentric ringportions, each ring portion corresponding to a different frequency inthe hearing assessment.
 105. A method as claimed in claim 103 or claim104, wherein the length of each ring portion corresponds to the strengthof hearing at the frequency associated with the ring portion.
 106. Amethod as claimed in claim 104 or claim 105, wherein the ring portionsare represented differently based on whether the ring portions areassociated with the left or right ear.
 107. A method as claimed in anyone of claims 104 to 106, wherein the ring portions are representeddifferently based on the frequency.
 108. A method as claimed in any oneof claims 70 to 107, comprising facilitating editing of the audiogramdata.
 109. A method as claimed in claim 108, comprising displaying avisual representation of the audiogram data, and enabling a person tomodify the visual representation and thereby the audiogram data.
 110. Amethod as claimed in any one of claims 70 to 109, comprising allowing aperson to modify the configuration data.
 111. A method as claimed inclaim 110, wherein the modifications include modification of a gain,feedback response, frequency response, or compression parameter.
 112. Amethod as claimed in any claim 111, wherein the configuration data isupdatable on-the-fly so that a wearer of the hearing device can hearchanges as they are being made.
 113. A method as claimed in any one ofclaims 70 to 112, comprising: analysing the audiogram data to determinewhether to communicate recommendation information to the person, therecommendation information indicative of a recommendation to carry out ahearing related action; and communicating the recommendation informationto the person if the determination is affirmative.
 114. A method asclaimed in claim 113, wherein the recommendation information isindicative of a referral to a health professional.
 115. A method asclaimed in claim 114, comprising retrieving the recommendationinformation from a referral database.
 116. A method as claimed in claim115, comprising retrieving the recommendation information based ondefined criteria.
 117. A method as claimed in claim 116, comprisingretrieving the recommendation information based on locality.
 118. Amethod as claimed in any one of claims 113 to 117, comprising comparinga user's electronic calendar with an accessible electronic calendar of aselected hearing health professional so that a mutually free timeslotfor the user and the hearing health professional can be identified. 119.A method as claimed in any one of claims 113 to 118, comprisinganalysing the audiogram data with reference to capabilities of a hearingdevice associated with a person, determining whether the capabilities ofthe hearing device are suitable for the hearing capabilities of theperson defined in the audiogram data, and communicating recommendationinformation indicative of a different hearing device if the differenthearing device has more suitable capabilities than the hearing deviceassociated with the person.
 120. A method as claimed in any one ofclaims 113 to 119, wherein the recommendation information may bedisplayed to the person and/or electronically communicated to one ormore relevant people.